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We analyze, on a random graph, a diffusive strategic dynamics with pairwise interactions, where 
nor Glauber prescription, neither detailed balance hold. We observe numerically that such a dy- 
namics reaches a well defined steady state that fulfills a shift property: the critical temperature of 
the canonical ferromagnetic phase transition is higher with respect to the expected equilibrium one, 
known both numerically via Glauber relaxation or Monte Carlo simulations as well as analytically 
via cavity techniques or replica approaches. 

We show how the relaxed states of this kind of dynamics can be described by statistical mechanics 
equilibria of a diluted p-spin model, for a suitable non-integer real p. Several implications from both 
theoretical physics and quantitative sociology points of view are discussed. 



PACS numbers: 



I. INTRODUCTION 



Born as a theoretical background for thermodynam- 
ics, statistical mechanics provides nowadays a flexible 
approach to several scientific problems whose depth and 
wideness increases continuously. In the last decades in 
fact complex systems statistical mechanics has invaded 
fields as diverse as spin glasses [l|, neural networks 0, 
protein folding 0], immunological memory and also 
made some attempt to describe social networks [j|, the- 
oretical economy [f| and urban planning Q ■ 
In this paper we study statistical mechanics of random 
diluted mean field systems, paying particular attention to 
its applications in social science: in a nutshell we show 
that the relaxed states of a particular non-Glauber two- 
body dynamics [1,11] can be "effectively" described by a 
diluted p-spin model for a suitable non-integer real p. 
After a review of the diffusive strategic dynamics previ- 
ously introduced in [T^, I 111 . [l2| , we implement it on an 
Erdos-Renyi mean field random model and work out the 
corresponding mean field equilibria: each agent (spin) is 
selected through a diffusive rule, and its flipping proba- 
bility is not weighed "a la Glauber" 0. The probabili- 
ties of its nearest neighbor flips are selected by favouring 
the flips which produce the maximum energy gain. We 
stress that this operation, although dynamically pairwise, 
effectively involves more than pairwise information eval- 
uation, as the chosen agent interacts both with the first 
selected one as well as with its nearest neighbors, as a 
whole. 

This dynamics is shown to relax to a well defined steady 
state, where all the properties of stationarity are recov- 
ered [l3j ] . However a peculiarity happens, with respect 
to the standard relaxation investigated both by means of 
Glauber dynamics 0, and well known both by Monte- 
carlo simulation and analytical results [l4[: the critical 
parameters (temperature, or cquivalently the inverse of 
the strength of the interactions) are higher, of a few per- 
cent, than the expected. 



The whole scenario suggests a "hidden" many body in- 
teraction, encoded into the particular rule for selecting 
the spins. To investigate this feature we perform further 
numerical analysis, which strongly supports a more-than- 
two body effective interaction. Then we work out analyt- 
ically a theory for the randomly diluted p-spin model so 
to fit an effective p £ R, which turns out to be p = 2.15, 
in order to match the numerical data available by the 
dynamics. This result has implication both in theoret- 
ical physics, as well as in quantitative sociology, where 
the effective interactions always play an important role 
in decision making [l5l . [l6j . 
The paper is organized as follows: 

In section [TT1 our dynamics is introduced and shortly dis- 
cussed; then further numerical investigations toward a 
better understanding of a p > 2 behavior are presented. 
In section IIIII the randomly diluted p-spin model is de- 
fined and exploited in all details, both analytically within 
the cavity field techniques as well as numerically, within 
a Montecarlo approach. Full agreement is found among 
the two methods. 

At the end, the last section is left for conclusions: the ef- 
fective interaction is found and its implications analyzed. 
Furthermore, even though the paper is written within a 
theoretical physics approach, remarks concerning the ap- 
plication to quantitative sociology are sparse through all 
the work. 

As a last remark, for a better reading of the manuscript, 
we decided to put all the long proofs of the various the- 
orems in the appendix. 



II. DIFFUSIVE STRATEGIC DYNAMICS 

In this section we shortly discuss the general approach 
for the numerical investigation of an Ising-like system [§[ , 
then we introduce a particular dynamics and we explain 
the motivation behind our choice. 
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A. A strategy avoiding Glauber prescription 

In order to simulate the dynamical evolution of a sys- 
tem described by a Curie- Weiss Hamiltonian Hn{<j), liv- 
ing on an Erdos-Renyi random graph [l4L , 

N 
ij 

where Aij is a Poisson random adjacency matrix that, 
on average, connects a, sites to the generic i th spin (and 
thcrmodynamically a, — > a, the connectivity, whenever 
A — > oo), several different algorithms have been in- 
troduced. Among them a well established one is the 
so-called single-flip algorithm, which makes the system 
evolve by means of successive spin-flips, where we call 
"flip" on the node j the transformation Sj — ► — Sj [li ]. 

More precisely, the generic single-flip algorithm is 
made up of two parts: first we need a rule according 
to which we select a spin to be updated, then we need a 
probability distribution which states how likely the spin- 
flip is. As for the latter, following the Glauber rule, given 
a configuration s, the probability for the spin-flip on the 
j-th node reads off as 

where Aif(s, j, J) = 2<x; ■ A^Uj is the variation in the 
cost function due to the flip Sj — > —Sj. Hence, for single- 
flip dynamics the cost variation AH, consequent to a 
flip, only depends on the spin of a few sites, viz. the j-th 
one undergoing the flipping process and its ctj nearest- 
neighbors (for the sake of clearness, we remember that 
the Erdos-Renyi, even if the amount of nearest neighbors 
is finite, still allows the model to be analyzed via mean- 
field techniques). 

As for the selection rule according to which sites are 
extracted, there exist several different choices, ranging 
from purely random to deterministic. In several contexts 
(condensed-matter physics sociology Q etc.) un- 
less no peculiar mechanisms or strategies are at work, 
the random updating seems to be the most plausible. In 
this case the probability that the current configuration s 
changes into s'j due to the flip Sj — ► —Sj, reads off as 

V n (s,j;3) = ±p( S ,j,3). (2) 

This algorithm mimics the coupling between the mag- 
netic system with the thermal vibrations of the underly- 
ing structure, usually meant as heat-bath. The dynamics 
generated by has been intensively studied in the past 
(see e.g. and it has been shown to lead the system 

to the canonical equilibrium distribution, derived form 
the cost function Hjf(a). 

However, there exist several other different mecha- 
nisms yielding single flips [20| . For example, we can think 



of a system endowed with a local thermostat where dif- 
fusing excitations affect the spin dynamics. Then it is 
reasonable to suppose that the spin-flips, and the related 
energy changes, have a diffusive character and that such 
a diffusion is biased towards those regions of the sample 
where energy variations are more likely to occur. Also in 
a social context a spin-flip can occur as a result of a direct 
interaction (phone call, mail exchange, etc.) between two 
neighbors and if agent i has just undergone an opinion- 
flip he will, in turn, prompt one out of his cti neighbors to 
change opinion (opinion in social context plays the role 
of the spin orientation in material systems). 

These aspects are neglected by traditional dynamics 
and can not be described by a random updating rule. In 
the past a different relaxation dynamics has been intro- 
duced and it is able to take into account these aspects, 
namely: 

i. the selection rule exhibits a diffusive character: The 
sequence of sites selected for the updating can be thought 
of as the path of a random walk moving on the underly- 
ing structure. 

ii. the diffusion is biased: The o>i neighbors are not 
equally likely to be chosen but, amongst the on neigh- 
bors, the most likely to be selected is also the most likely 
to undergo a spin-flip, namely the one which minimizes 
AH(s,j,3). 

Let us now formalize how the dynamics works. Our 
MC simulations are made up of successive steps 0] : 

- Being i the newest updated spin/agent (at the very 
first step i is extracted randomly from the whole set of 
agents), we consider the corresponding set of nearest- 
neighbors defined as Mi = ...,i a ^\ we possibly 
consider also the subset Mi C Mi whose elements are 
nearest- neighbors of i not sharing the same orienta- 
tion/opinion: j e Mi ^ j G Mi A SiSj = —1. Now, 
for any j € Mi we compute the cost function variation 
AH(s,j,J), which would result if the flip Sj — ► —Sj 
occurred; notice that AH(s,j, J) involves not only the 
nearest- neighbors of i. 

We calculate the probability of opinion- 
flip for all the nodes in Mi, hence obtaining 
p(s,ix, 3),p(s,i 2 , 3),...,p(s,i ai , J), where p(s, s^,J) 
(see Eq. [I]), is the probability that the current configu- 
ration s changes due to a flip on the j-th site. 

- We calculate the probability V (s; i, j; J) that among 
all possible cti opinion-flips considered just the j-th one 
is realized; this is obtained by properly normalizing the 
P(s, j, J): 

V [s;i,j; J) = — . (3) 

2^ p{s,k,3) 

We can possibly restrict the choice just to the set Mi, 
hence defining V s (s; i, j; J) = p(s, j, J)/ T,keJ^i p ( s ' fc ' J )' 
Notice that, as we have verified, the use of V s instead of 
V s does not imply any qualitative change in the results. 

- According to the normalized probability V (see 
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Figure 1: Critical behavior of the magnetization for the two 
dynamics (diffusive and standard Glauber) as a function of /3 
and fixed a = 10. The former dynamics gives rise to a critical 
point higher with respect to the latter. 

Eq. [3]), we extract randomly the node i G M and realize 
the opinion flip sj — > — sj. 

- We set i = i and we iterate the procedure. 

Finally, it should be underlined that in this dynam- 
ics detailed balance is explicitly violated [1, ; indeed, 
its purpose is not to recover a canonical Bolzmann equi- 
librium but rather to model possible mechanism making 
the system evolve, and ultimately, to describe, at an ef- 
fective level, the statics reached by a "socially plausible" 
dynamics for opinion spreading [8|. 

B. Equilibrium behavior 

The diffusive dynamics was shown to be able to lead 
the system toward a well defined steady state and to re- 
cover the expected phase transition, although the critical 
temperature revealed was larger than the expected one 
ficj ]. Such results were also shown to be robust with re- 
spect to the the spin magnitude 0] and the underlying 
topology [1]. 

In particular, it was evidenced that there exists a crit- 
ical value of the parameter (3f below which the system is 
spontaneously ordered. However, (3f was found to be ap- 
preciably smaller than the critical value f3 c {a) expected 
for the canonical Ising model on a Erdos-Renyi random 
graph. Interestingly, it is not possible describe the sys- 
tem subjected to the diffusive dynamics by introducing 
an effective Hamiltonian obtained from Eq pi A[) by a 
trivial rcscaling. In fact, we consider the dependence 
on the magnetization displayed by the energies E (m) 
and E(m), measured for system evolving according to 
the diffusive dynamics and to a traditional dynamics, re- 
spectively. As for the latter, from Eq. (jll A[) it is easy to 
see that E = m 2 . As for E s (m), we found that E s < E 
for < m < 1, while E s = E for m = and m = 1. This 
is compatible with a power law behaviour E s ~ m 2+e . In 



order to obtain an estimate for e we measured the ratio 
E s /E as a function of m; data are shown in the log- log 
scale plot of Fig. 2. Now, fitting procedures suggest that 
e « 0.15. Notice that the large deviations from the linear 
behaviour evidenced at small value of (m) are due to the 
fact that we are dividing two quantities close to zero. 

So our idea is the following: as the critical temperature 
raises with p ranging from two to infinity, there can be a 
suitable real value of p that matches the critical temper- 
ature found numerically, and this is compatible with the 
plots of E s {m) and E(m). Notice that for p > 2,p G N, 
ferromagnetic transitions are no longer critical phenom- 
ena. At the critical line "jumps" in the magnetization 
and a latent heat do exist. However, if p is though of 
as real, for p slightly bigger than two, as suggested by 
our data, such a jump should be small (and it goes to 
zero whenever p — > 2), so it is difficult to check it just 
by looking at the magnetization as a function of a, (3. To 
investigate this property, noting that the discontinuity of 
the entropy (latent heat) can be checked by looking at 
the compression rate of the phase space via the Shannon 
Theorem, we show the compression rate of the strategic 
dynamics R s normalized by the compression rate of the 
Glauber one R, which offers another indication of the 
presence of a p > 2 behavior. In fig. 2, bottom panel, we 
plot C = R s /R as a function of the inverse temperature 
f3; a minimum occurs just at the critical temperature of 
the system evolving according to the strategic dynamics. 

III. STATICS OF MANY BODY 
INTERACTIONS 

In this section we introduce a p-spin model to match 
the steady state recovered by the diffusive dynamics. 

A. The diluted even mean field p-spin ferromagnet 

In this section we exploit the properties of a diluted 
even p-spin ferromagnet: we restrict ourselves only to 
even values of p for mathematical convenience (the in- 
vestigation with the cavities is much simpler), but, due 
to monotonicity of all the observables among p, there is 
no need to think at this as a real restriction (furthermore 
simulations on odd values of p confirm this statement). 
First of all, we define a suitable Hamiltonian acting on 
a Erdos-Renyi random graph, with connectivity a, made 
up by agents = ±1, i G [1, N]. 
Introducing p families {i},}, {*^}, of i.i.d. random 

variables uniformly distributed on the previous interval, 
the Hamiltonian is given by the following expression 

H N (a,j(a)) = - ^2 ( 4 ) 

!/=l 

where, reflecting the underlying network, k is a Pois- 
son distributed random variable with mean value 7(a)iV. 
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Figure 2: Up: We extrapolate from m(/3) and E(/3) the plot 
E(m) for both the dynamics. It is worth noting that the diffu- 
sive dynamics deals to a curve living always "below" the one 
obtained by Glauber dynamics results. This strongly suggest 
the cooperation of p > 2 spins each interaction. Down: We 
show the phase space compression ratio C = R s /R, where R a 
is the phase space compression of the strategic dynamics and 
R stands for the standard Glauber one. 



The relation among the coordination number a and 7 is 



7 oc a 



: this will be easily understood a few line later 
by a normalization argument coupled with the high con- 
nectivity limit of this mean field model. 

The quenched expectation of the model is given by the 
composition of the Poissonian average with the uniform 
one performed over the families 



The Hamiltonian ([4]), as written, has the advantage 
that it is the sum of (a random number of) i.i.d. terms. 
To see the connection to a more familiar Hamiltonian 
wrote in terms of adjacency tensor , we note 

that the Poisson-distributed total number of bonds obeys 
P~ (N = 77V + 0(VW) for large N. As there are N p or- 
dered spin p-plets (£1, ...,i p ), each gets a bond with prob- 
ability ~ a/N for large N. The probabilities of getting 
two, three (and so on) bonds scale as l/N 2 , l/N 3 , ... so 
can be neglected. The probability of having a bond be- 
tween any unordered p-plet of spins is p\ as large, i.e. 
2a/N for p = 2. 

It is possible to show that our version of the Hamiltonian 
in fact is thermodynamically equivalent with the more fa- 
miliar involving the explicit adjacency tensor A^...^ , by 
recall at first both the models 



H N (a;k)~ -H N (a) 



N 

E 



-4, 



where k is a Poisson variable with mean "/N 



o 



(9) 



P-iN 



and Ai 



are all independent Poisson variables of 



mean -f/NP' 1 - {a/N)''- 1 . 

Then, it is enough to consider the streaming of the fol- 
lowing interpolating free energy (whose structure proves 
the statement a priori by its thermodynamics meaning), 
depending on the real parameter t G [0,1] 



where k is a Poisson random variable with mean "fNt 
and Aj fl i p are random Poisson variables of mean (1 — 
tyj/NP^ 1 , so note that the two models separated are re- 
covered in the two extremals of the interpolation (for 
t = 0, 1). By computing the i-derivative, we get 



1 d(j>{t) 
1 



dt 



Eln(l + nfoi. 

ln(l 



1 

Np 



N 

E 



.(7 jg )tanh(/3)) (10) 
hfi(<T il ... CTip )tanh(/?)) = 0, 



Ef 



= E P E l [-}=J2 



e -7(a)tf( 7 ( a )jv)k 



fc=0 



MNP 



l,N 

E 



(5) 



As they will be useful in our derivation, it is worth 
stressing the following properties of the Poisson distribu- 
tion: Let us consider a function g : N — > R, and a Poisson 
variable k with mean 77V, whose expectation is denoted 
byE. 

It is easy to verify that 



E[kg(k)] 
d lN E[g(k)} 
d 2 hN)2 E[g(k)} 



jNE[g{k- 1)] 
E[g(k+l)-g(k)] 
E[g(k + 2) - 2g(k - 



(6) 
(7) 

■»(*)]■ (8) 



where the label in Iq stands for a new spin, born in 
the derivative, accordingly to the Poisson property l|7]); 
as the zo's are independent of the random site indices in 
the t-dependent f2 measure, the equivalence is proved. 

Following a statistical mechanics approach, we know 
that the macroscopic behavior, versus the connectivity 
a and the inverse temperature (3, is described by the 
following free energy density 



A(a,(3) = lim A N (a,/3) 

N^OQ 



(11) 



lim — Em) cxp(-(3H N (a,j(a))). 

N^oc N z — ' 



5 



The normalization constant can be checked by perform- 
ing the expectation value of the cost function: 



E[H] = -jNr 



~E[H 2 } — ~E Z [H] = 7 2 7V 2 



(^ 2 - m p)+0(l)],(12) 



by which it is easy to see that the model is well defined, 
in particular it is linearly extensive in the volume. Then, 
in the high connectivity limit each agent interacts with 
all the others (a ~ N) and, in the thermodynamic limit, 
ol — ► oo. Now, if p = 2 the amount of couples in the 
summation scales as N(N — l)/2 and, with 7 = 2a, a 
linear divergence of a (desired to get a finite ratio a/N 
for each coupling) provides the right scaling; if p = 3 the 
amount of triples scales as N(N— 1)(N— 2)/3! and, with 
7 = 3!a 2 , again wc find the right connectivity behavior. 
The generalization to every finite p < N is straightfor- 
ward. 



B. Properties of the random diluted p-spin model 

Let us now introduce the whole statistical mechanics 
machinery: we start by the partition function defined as 



^v(7,/?)=E' 



-/3iM<r,7) 



(13) 



the quenched pressure can be written as 



1 



A N (l,P) = -ElnZ N (j,f3), 



the Boltzmann state is given by 



/3H N {<r,~/) 



with its replicated form 

n(g(a))=l[J s Hg(a^)) 



(14) 



(15) 



and the total average (g(cr)) is defined as 

(g(a))=E[Q(g(a))}. (16) 



Before starting our free energy analysis, we want to 
point out also the connection among this diluted version 
and the fully connected counterpart. 
Let us remember that the Hamiltonian of the fully con- 
nected p-spin model (FC) can be written as [2l[ 



H F N C {a) 



p\ 



2NP- 



E 



(18) 



and let us consider the trial function A(t) defined as fol- 
lows 



A(t) = — ElnJ^exp [/3 ^ a i ia i 2...a i p+{l-t) 



(3'N ■ 
— m" 

(19) 

which interpolates between the fully connected p-spin 
model and the diluted one, such that for t = only the 
fully connected survives, while the opposite happens for 
t = 1. Let us work out the derivative with respect to t 
to obtain 



d t A(t) = (p-l)o! p - 1 lncosh(/3) 



(20) 



-1™ 



by which we see that the correct scaling, in order to re- 
cover the proper infinite connectivity model, is obtained 
when a — > 00, ft — > and (3' = 2(p — l)^^ 1 tanh(/3) is 
held constant. 

Remark 1 It is worth noting that in social modeling, 
usually, the role of the temperature is left, or at least 
coupled together, to the interaction strength J. As a con- 
sequence, in order to keep (3 1 fixed, on different network 
dilution, the strength must be rescaled accordingly to 



J = tanh 



2(p-l) 



: ) 



while, if present, an external field remains unchanged as 
it is a one-body term, like h Ylf dj , unaffected by dilu- 
tion. 

Remark 2 The dilute p-spin model reduces to the fully 
connected one, in the infinite connectivity limit, uni- 
formly in the size of the system. 



Let us introduce further, as order parameters of the the- 
ory, the multi-overlaps 

1 N 

qi...n = Jf2^ a i > 
i=l 

with a particular attention at the magnetization m = 
qi = (1/N) 2j=i a i ano - to the two replica overlap q\2 = 



C. The smooth cavity approach 

In this section we want to look for an iterative ex- 
pression of the free ene rgy density by using a version 
of the cavity strategy [22, that we briefly recall: 
the idea behind the cavity techniques P, HI] , which, for 
our purposes, resembles the stochastic stability approach 
[25L l26l | , is that information concerning the free energy 
density can be extrapolated when looking at the incre- 
mental extensive free energy given by the addition of a 
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spin. 

In diluted models, this pasted spin changes also (infinites- 
imally in the high N limit) the connectivity and in eval- 
uating how the free energy density varies conformingly 
with this, we are going to prove that it can be written in 
terms of a cavity function and such a connectivity shift. 
So the behavior of the system is encoded into these 
two terms. The latter is simpler as it is made only by 
stochastically stable terms (a proper definition of these 
terms will follow through the section). The former, in- 
stead, must be expressed via these terms and this will be 
achieved by iterative expansions. 

At first we show how the free energy density can be de- 
composed via these two terms (the cavity function and 
the connectivity shift). Then, we analyze each term sep- 
arately. We will see that they can be expressed by the 
momenta of the magnetization and of the multi-overlaps, 
weighted in a perturbed Boltzmann state, which recovers 
the standard one in the thermodynamic limit. 

Theorem 3 In the thermodynamic limit, the quenched 
pressure of the even p-spin diluted ferromagnetic model 
is given by the following expression 

A(a, (3) = In 2 - 0) + *(a, /3, t = 1), (21) 

p — 1 da 

where the cavity function \I/(i, a,/3) is introduced as 



E 

E 

with 



In 



In 



Sf 



PmiH cr i -tu i 2...cr i p PJ2v=i a il a i1 ■■■" i p-i 



*jv(7,/M), 



#(7,/M) = Jam V N (l,f3,t). 

TV— >oc 



(22) 



(23) 



For the sake of clearness, to avoid interrupting the paper 
with a long technical calculation, the proof of the Theo- 
rem is reported in the Appendix. 

Thanks to the previous theorem, it is possible to figure 
out an expression for the pressure by studying the prop- 
erties of the cavity function ^(a,/3) and the connectivity 
shift d a A(a,/3). 

Using the properties of the Poisson distribution |6j 0. 
we can write 



(^J) a P-2i. E [ mZjv(7)(3) 



N 



dj 



ln^e 

M 



M 



Now considering the relation (and definition) 



8(7 1 ...Op 

e l o l o 



cosh/3 + cr i i...Oig sinh/3, (24) 
9 = tanh/3, (25) 



we can write 



Ta A ^ 



(26) 



{p- l)a p ~ 2 In cosh/3 + E[ln(l +oj(a t i... 0-^)0)] 

At the end, expanding the logarithm, we obtain 
d 



da 



A(a,(3) = (p- l)a p_ ^lncosh/3 



(27) 



(-11™ 



With the same procedure it is possible to show that 
d 



dt 



*(<S,/3,t) = 25 p ~ i lncosh^- 



(28) 



* — * n 



by which,we see that even the cavity function, once in- 
tegrated back against t the r.h.s. of cq. ([2"8")) . can be ex- 
pressed via all the order parameters of the model. 



$(&,f3,t) = 2&P- 1 (lncosh(f3)-J2 



( 



/ p~ i \ 

Wl nia,t 



So we can understand the properties of the free en- 
ergy by analyzing the properties of the order parameters: 
magnetization and overlaps, weighted in their extended 
Boltzmann state ait- 

Further, as we expect the order parameters being able 
to describe thermodynamics even in the true Boltzmann 
states uj,n [I?} , accordingly to the following definitions, 
we are going to show that filled order parameters (the 
ones involving even numbers of replicas) are stochasti- 
cally stable, or in other words, are independent by the t- 
perturbation in the thermodynamic limit, while the oth- 
ers, not filled, become filled, again in this limit (such that 
for them uj t — ► uj in the high N limit and thermodynam- 
ics is recovered). The whole is explained in the following 
definitions and theorems of this section. 

Definition 4 We define the t- dependent Boltzmann 
state ujt as 



w t (5(er)) = 
1 



(29) 



where Z^ it (j,f3) extends the classical partition function 
in the same spirit of the numerator of eq. i29\) itself. 
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We see that the original Boltzmann state of a TV-spin sys- 
tem is recovered by sending t — ► 0, while, sending t — ► 1 
and gauging the spins, it is possible to build a Boltz- 
mann state of a N + 1 spins, with a little shift both in 
a,/3, which vanishes in the N — > oo limit, as prescribed 
in (22,23). 

Coherently with the implication of thermodynamic limit 
(by which Ajv+i(a,/3) — Ajv(a,/3) = for N — * oo), we 
are going to define the filled overlap monomials and show 
their independence (stochastic stability) with respect to 
the perturbation encoded by the interpolating parameter 
t. 

These parameters are already "good" order parameters 
describing the theory, while the others (the not-filled 
ones) must be expressed via the formers, and this will be 
achieved by expanding them with a suitably introduced 
streaming equation. 

Definition 5 We can split the class of monomials of the 
order parameters in two families: 

• We define filled or equivalently stochastically sta- 
ble those overlap monomials with all the replicas 
appearing an even number of times (i.e. q\ 2 , m 2 , 

<Zl2?349l234/- 

• We define non-filled those overlap monomials with 
at least one replica appearing an odd number of 
times (i.e. q 12 , m, <7i2<W- 

We are going to show three theorems that will play a 
guiding role for our expansion: as this approach has 
been deeply developed in similar contexts (as fully con- 
nected Ising and p-spin models [U [23| , fully connected 
spin glasses [22[ or diluted ferromagnetic models [TJ, HH , 
which are the "boundaries" of the model of this paper) 
we will not show all the details of the proof, but we sketch 
them in the appendix as they are really intuitive. The 
interested reader will found a clear derivation in the ap- 
pendix but can deepen this point by looking at the orig- 
inal works. 

Theorem 6 In the thermodynamic limit and setting t = 
1 we have 

UN,t{o~i 1 G~i2--- ~i n ) — ^N+i{o~i 1 o-i 2 ...a in a^ +1 ). (30) 

Theorem 7 Let Q a i, be a not-filled monomial of the 
overlaps (this means that q a bQab is filled). We have 

lim lim(Q a b)t = (q a bQab), (31) 

TV— >oc t— >\ 

(examples: 

for N > oo we get (mi) t -> (mf), (q 12 )t -* (qh))- 

Theorem 8 In the N — > oo limit, the averages (•) of the 
filled polynomials are t-independent in (3 average. 



D. Properties of the free energy 

In this section we are going to address various points: 
at first we work out the constraints that the model 
must fulfil, which are in agreement both with a self- 
averaging behavior of the magnetization as with the 
replica-symmetric behavior of the multi-overlaps [2^ |: 
then we write an iterative expression for the free energy 
density and its links with known models as diluted ferro- 
magnets (p — ► 2 limit) and fully connected p-spin models 
(a — > oo limit). 



With the following definition 

= 2( P -i)a p - 1 e 



2(p-l)a p - 1 



N 



N + 1 



(32) 



we show (and prove in the appendix) the streaming of 
replica functions, by which not filled multi-overlaps can 
be expressed via filled ones. 

Proposition 9 Let F s be a function of s replicas. Then 
the following streaming equation holds 



d(F s ) 



dt 



s 

P^iFsm*- 1 )^*- s(F s m p s -l) 



a=l 

1,8 



(33) 



a<b a=l 

s(s + 1) 



2! 



■{F a q£l a+2 )t,a] +0(8 3 ). 



Remark 10 We stress that, at the first two level of ap- 
proximation presented here, the streaming has has the 
structure of a 8-weighted linear sum of the Curie- Weiss 
streaming (8° term) \23J and the Sherrington- Kirkpatrick 
streaming (8 1 term) \2&} . conferring a certain degree of 
independence by the kind of quenched noise (frustration 
or dilution) to mathematical structures of disordered sys- 
tems. 



It is now immediate to obtain the linear order parame- 
ter constraints (often known as Aizcnman-Contucci poly- 
nomials [H, [25|, [28[) of the theory: in fact, the generator 
of such a constraint is the streaming equation when ap- 
plied on each filled overlap monomial (or equivalently it 
is possible to apply the streaming on a not-filled one and 
then gauge the obtained expression; for the sake of clear- 
ness both the methods will be exploited, the former for 
<72 and the latter for m). 

As examples, dealing with the terms m p_1 and q^ 1 , it 
is straightforward to check that 







lim 



d(m p N 

dt 



01 (m 



2(P-1)\ 



,P-1\2 



+ ~08((m p - 1 q p 2 - 1 ) - K" 1 )^- 1 )) +0(8% 
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then, by gauging the above expression, in the thermody- 
namic limit, (as lmiN^ oc (m p ^ 1 ) t — ► (m p )), we get 







(«mf ) - {ml) 2 ) + 9((q 2 2 p ) (^) 2 )) = Vtf e K + , 

which, as holds for every 9 suggests both self-averaging 
for the energy (by which all the linear constraints can 
be derived [28|) due to the first term, as well as replica 
symmetric behavior of the two replica overlap due to the 
last one. 

In the same way, the contribution of the (q 2 ) generator 
is 

(((^mf- 1 ) + {q^mV) - 2<&- 1 mr 1 » + 

+ O^q^ 1 ) -4(&- 1 g| 3 - 1 ) +3(^ 1 gf 4 - 1 ))), 

which shows replica symmetric behavior of the magne- 
tization by the first term and the classical Aizenman- 
Contucci relations [HI, HH by the latter. 

Furthermore, turning now our attention to the free en- 
ergy, it is easy to see that the streaming equation allows 
to generate all the desired overlap functions coupled to 
every well behaved F s . In this way, if F s is a not filled 
overlap, we can always expand recursively it into a filled 
one, with the only price to pay given by the order that 
has to be reached or, which is equivalent, the number of 
derivatives that have to be performed. 
Let us now remember the t-derivative of the cavity func- 
tion (f55|) . showing explicitly the first two terms of its 
expansion 



{m 7 [^ 1 m 2 ~ l )t and {m 1 ^ l q\ 2 l )t can be saturated in two 
steps of streaming. This will be sufficient, wishing to 
have a fourth order expansion for the cavity function. 
We now derive these two functions and apply the same 
scheme to all the overlaps that appear and that have to 
be necessary filled in order to obtain the desired result. 



d{m\ )* 
dt 



2(3 (ml^mP-^t - (mf 1 m v 2 J mf" ') 



V— 1 p— 1 p— 1\ 



l P -l\ 
9l2 ) 



A I P—1 P—1 P— 1\ 

4(777^ 777^ q{ 3 ) t 



d(777? (p - 1) 777r 1 >* 



dt 



(35) 



(36) 



P 



unfilled terms 



0{9 2 ). 



Integrating back in t and neglecting higher order terms 
we have 



(m^mr 1 )* = P 



2(p-l) 2(p-l) N 



t, 



n '"-2 
and we can write 

(ml 7775 ) t = 

peim^m^qf-^t + f3 2 (mf p - 1] ] m 2 2 {p - l) )t 2 



(37) 
(38) 



Let us take a look now at the other overlap (m\ l q\ 2 1 ) 



j t *(a,p,t) 



2<F~ 1 lncosh/? + /3(mf~ 1 

OO 



(34 ) tiWi 1 ), 



-l n 9 n 



dt 



= P 



2(P-1) jp-1 



P- 1 , 



-1 P"l\ 



q\ 2 )t - (m\ 777 2 q\ 2 ) t 



12 /a,t 



n—3 



n 



p-1 



0/ p—1 p—1 p—1 p— 1\ 

2 < m l m 2 m 3 ?12 



0(9 2 )(39) 



As derivative of tillable terms involve filled ones, 
we can arrive to an analytical form of ^(a,P) if we 
calculate it as the t-intcgral of its t-dcrivative, together 
with the obvious relation ^(t = 0) = 0. So, if we 
apply the streaming equation machinery to the overlaps 
constituting equation ([34]) . we are able to fill them 
and to get them free from the t-dependence in the 
thermodynamic limit. In this way we are allowed to 
bring them out from the final t-intcgral. 
In fact, without gauging (so, not only in the crgodic 
regime, where symmetries are preserved), we can expand 
the streaming of (m p_1 ) t : 



d(m\ 



p-i\ 



dt 



= P 

- pe 



2(p-l)\ 



p—1 p—1 



(m\ m% )t 



that gives 

K" 1 ^- 1 )* = Hmr'mtW^t + 0(9 2 ). (40) 

At this point we can write for (m 1 [~ l ) t ,d, (and conse- 
quently for )t,&) 

(m{-\ & = /3(777^- 1 ))t-|(777^- 1 )777^- 1 ^ 3 

- p 2 9(mr 1 m p 2 - 1 q P 1 2 1 )t 2 + 0(9 3 ), 

= M^ 1) )t + P 2 {<- 1 <- 1 ql 2 1 )t 2 + 0{9^). 

With these relations, eq. (|34|) becomes 
d 



T12 It - [m\ q' 23 



0(9 2 



dt 



We can note the presence of the filled monomial 
(m 2 1 ), whose t-dependence has been omitted explic- 
itly to underly its stochastic stability, while the overlaps 



V N (a,P,t) = 2a p - 1 lncosh/3 + /3 2 (m 2(p ~ 1) )t 

P 2 9 2 2(p-i) x , 3/3 3 6> „_! p _i p _u 2 
~2~Wia ) l ^-( m i m 2 I12 )t 

V I 2(p-l) 2(p-l)>,3 ^m5\ 

— (m^ >m 2 yF ')V + 0{9'), 
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which ultimately allows us to write an iterated expres- 
sions for 4" evaluated at t = 1 

*at(o,A1)= (41) 
2a- 1 In cosh /3 + f (mf^) - ^(^) - 

Overall the result we were looking for, a polynomial form 
of the free energy, reads off as 

A(a,j3) = In 2 + a p ~ l In cosh /? + (42) 

+ f(/3'(«^- 1 ))-(mf))+ (43) 

+ ^(/3'^r i) >-<^>)+o(^). 

Now, several conclusions can be addressed from the 
expression (|42|): 

Remark 11 At first let us note that, by constraining the 
interaction to be pairwise, critical behavior should arise 
fHP\ ]. Coherently, we see that for p = 2 we can write the 
free energy expansion as 

A(a,f3) p=2 = ln2+ a lncosh(/3)-^(l- / 3')(m 2 )-^(< Z2 2 ), 

which coincides with the one of the diluted ferromagnet 
fl~$ l and displays criticality at 2a8 = 1, where the coef- 
ficient of the second order term vanishes, in agreement 
with previous results fl^t l. 

Remark 12 The free energy density of the fully 
connected p-spin model is fgH / A{(3') = In 2 + 
lncosh(/3m p_1 ) — (f3/2)m p , which coincides with the ex- 
pansion l[42fy in the limit of a — > oo and (3^0 with 
/3' = 2(p- l)a p - 1 6. 

Remark 13 It is worth noting that the connectivity no 
longer plays a linear role in contributing to the free en- 
ergy densit y, a s it does happen for the diluted two body 
models fl2 . 1 1 ill, but, in complete generality asp—1. This 
is interesting in social networks, where, for high values 
of coordination number it may be interesting developing 
strategies with more than one exchange flt\ ]. 

Remark 14 As from the numerics discussed in Sec- 
tion 2, the effective p turns out to be 2.15; to check 
for consistency with the analytic results, we note that 
close to criticality (p = 2), the temperature for the 
phase transition is given by (3 C = tanh _1 (l/2a p_1 ) = 
tanli (l/2a). Now, forp = 2.15 this expression becomes 
(3 C ~ tanh^l^aP- 1 ) = tanh" 1 (l/2a 115 ): The ratio 
among the two expressions, when evaluated for a = 10 
gets approximately 1.4, in agreement with data depicted 
in Fig. 1. 



E. Numerics 

We now analyze the system described in this section, 
from the numerical point of view by performing extensive 
Monte Carlo simulations. Within this approach it is more 
convenient to use the second Hamiltonian introduced (see 
eq.©): 

N N 

H N (a) = -]TVi! ^2 A iu .... ip o-i 2 a i3 ...a ip . 

ii «2<i3<---<*p = l 

(44) 

The product between the elements of the adjacency ten- 
sor ensures that the p — 1 spins considered in the second 
sum are joined by a link with i\. 

The evolution of the magnetic system is realized by 
means of a single spin flip dynamics based on the 
Metropolis algorithm At each time step a spin is 

randomly extracted and updated whenever its coordina- 
tion number is larger than p — 1. For a large enough (at 
least above the percolation threshold, as obviously it is 
the case for the results found previously) and p = 3, 4 this 
condition is generally verified. The updating procedure 
for a spin 0{ works as follows: Firstly we calculate the 
energy variation AEi due to a possible spin flip, which 
for p = 3 and p = 4 reads respectively 

N 

AEi = 2a, A ^o A i,kO-jO-k, (45) 

j<k=l 
N 

AEi = 2a t A l jA %k A i ^ w o- j o- k o- w . (46) 

j<k<w=l 

Now, if AEi < 0, the spin-flip o~i — ■> — Oi is realized with 
probability 1, otherwise it is realized with probability 

The case p = 3 has been studied in details and some 
insight is provided also for the case p = 4, while for 
p = 2 we refer to [Tij ]. Our investigations concern two 
main issues: 

- the existence of a phase transition and its nature 

- the existence of a proper scaling for the temperature as 
the parameter a is tuned. 

As for the first point, we measured the so-called Binder 
cumulants defined as follows: 

Gn(T)^1-^L, (47) 

where (■) y indicates the average obtained for a system of 
size N [3Cj . The study of Binder cumulants is particularly 
useful to locate and catalogue the phase transition. In 
fact, in the case of continuous phase transitions, Gn(T) 
takes a universal positive value at the critical point T c , 
namely all the curves obtained for different system sizes 
N cross each other. On the other hand, for a first-order 
transition Gat(T) exhibits a minimum at T m i n , whose 
magnitude diverges as N. Moreover, a crossing point at 
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Figure 3: Binder cumulants Gl(T) for systems of different 
size JV, as shown in the legend, and connectivity a = 50 (left 
panel) and a = 80 (right panel). 



Figure 4: Magnetization (main figure) and its normalized fluc- 
tuations (inset) for systems of different sizes and different di- 
lution as a function of j3 oF~ . The collapse of all the curves 
provides a strong evidence for the scaling of the temperature. 



T cross can be as well detected when curves pertaining 
to different sizes N are considered [3l|. Now, T m i n and 
Tcross scale as T m in T c oc N and T cross T c oc N , 
respectively. 

In Fig. [3]we show data for Gjv(T) obtained for systems 
of different sizes (N = 400, N = 500, and N = 800) but 
equal connectivity (a = 50 and a — 80, respectively) 
as a function of the temperature T. The existence of a 
minimum is clear and it occurs for T w 625 and T as 
1600. Similar results are found also for p = 4 and they 
all highlight the existence of a first-order phase transition 
at a temperature which depends on the connectivity a. 

In order to deepen the role of connectivity in the evolu- 
tion of the system we measure the macroscopic observable 



and its (normalized) fluctuations 



study- 



ing their dependence on the temperature j3 and on the 
dilution a. Data for different choices of size and dilution 
are shown in Figure 0] 

The profile of the magnetization, with an abrupt jump, 
and the correspondent peak found for its fluctuations 
confirm the existence of a first order phase transition 
at a well defined temperature T c whose value depends 
on the dilution a. More precisely, by properly normaliz- 
ing the temperature in agreement with analytical results, 
namely j3 = a p_1 we found a very good collapse of all 
the curves considered. Hence, we can confirm that the 
temperature scales like aP~ x . Moreover our data provide 
a very clear hint suggesting that the critical temperature 
can be written asT = a p_1 /4. 



state equilibria show a shifted- temperature phenomena: 
the Hamiltonian equilibria differ from the stationary one. 
We propose an effective Hamiltonian description of the 
last by means of an analytically continued random p- 
spin model which turns out to provide a good approxi- 
mation for the steady state for p = 2.15. The analysis 
of the free energy functional suggests moreover that the 
connectivity gives a non linear contribution to the equi- 
librium state. This open the possibility to consider ex- 
tended models in which the connectivity is a dynamical 
variable for the system and is chosen thermodynamically 
to maximize stability. We plan to return on that topic in 
future works. 



V. APPENDIX: ANALYTICAL PROOFS 

In this section the proofs of al the Theorems and the 
Proposition 1 are reported. 



Proof of Theorem [3] 

Bridging a system made of by N + 1 spins with one made 
of by N spins implies the definition of rescaled 7, a pa- 
rameters, accordingly to [3, [28[ 



IV. CONCLUSIONS 

We have seen in this work a numerical and analytical 
study of a a diffusive strategy modeling group compe- 
tition. The study is performed on a standard random 
graph in a ferromagnetic mean field model. The steady 



N 



7 = 7 



N+ 1 



N 



N + l 



N- 



p-i JV— >oo 



(48) 
(49) 



We have, in distribution, the Hamiltonian of a system 
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made of N + 1 particles writable as 
Hn+i(ct,j) = — 2J ^"'jg— ^iS 



(50) 



i/=l i/=l 

that we may rewrite as 

H N+1 {<T :1 ) = H N (a,j) + H N (a,2j). (51) 



Following the above decomposition, let us consider the 
partition function of the same N+l spin model and let us 
introduce the gauge transformation er.; — * (TiaN+i which 
is a symmetry of the Hamiltonian known as spin-flip. 

Z N+1 (rf,0) ~ e - pHr '^- p6N ^ aN + 1 = (52) 

{a N + 1 } 



E 



o /3ffj V (er,7)+ / 3 J2 v 2 Ji a i\ ■■■(?. p-i cjv + i 
{ctjv + i} 

— 2 g/ 3 ^^™ +/ 3 E«>i , i ••• cr i g-i _ 

= 2^(7, /^(e" 3 ^), 

where the new Boltzmann state u), and its replicated f2, 
are introduced as 



e -/3_H N (7,<r) 



, (53) 
(54) 



To continue the proof we now take the logarithm of both 
sides of the last expression in eq. (|52[) . apply the expec- 
tation E and subtract the quantity E[lnZjv+i(7, /?)]. We 
obtain 

E[lnZ JV+1 (7,/3)]-E[lnZ JV+1 (7,/3)] = 

In 2 - E[ln ^M] + ^( 7 , ft l), (55) 

The left hand side gives 

EpnZ*+i(7,/3)] - E[lnZ w+1 ( 7 ,/3)] = (56) 
= (7- 7 )^E[lnZ JV +i(7,/3)]| 7 = T = 

= 7^-^+1(7, £)• (57) 

Considering the a dependence of 7, we have 

n 1 n dad 

9 ^ (p-l)a*-i da * ^ AQC —lda- A > 



where the symbol oc instead of = reflects the arbitrariness 
by which we include the p\ term, multiplying a, inside the 
definition of 7, or directly in a. 

Performing now the thermodynamic limit, we see that at 
the right hand side we have 



n^oo 1 Z N (a,/3) - 
and the theorem is proved □. 



A(a,[3) 



(58) 



Proofs of Theorems [6l[71[8l 

In this sketch we are going to show how to get Theorem 
<j6j) in some details; It automatically has as a corollary 
Theorem which ultimately gives, as a simple conse- 
quence when applied on filled monomials, Theorem©. 
Let us assume for a generic overlap correlation function 
Q, of s replicas, the following representation 

s n a 
a— 1 if l—l 

where a labels the replicas, the internal product takes 
into account the spins (labeled by /) which contribute to 
the a-part of the overlap q a , a ' and runs to the number 
of time that the replica a appears in Q. The external 
product takes into account all the contributions of the 
internal one and the / factor fixes the constraints among 
different replicas in Q; so, for example, Q = (712(723 can 
be decomposed in this form noting that s = 3, n 1 = 
1, n 2 — 2, I = N^Sq ;i 3 5j2 ^3, where the S functions fixes 
the links between replicas 1,3 — ► qi^ and 2,3 — > (72,3. 
The averaged overlap correlation function is 



(Q> t =E£j({,T})nc*(n<4). 

if a—1 l — l 

Now if Q is a tillable polynomial, and we evaluate it at 
t = 1, let us decompose it, using the factorization of the 
uj state on different replica, as 



(Q) t = e ]r /({<?}, n u, a (Q of. ) n 4 ). 



1=1 



b—u 



1=1 



where u stands for the number of the unfilled replicas 
inside the expression of Q. So we split the measure O into 
two different subset u a and LOb'- in this way the replica 
belonging to the b subset are always in even number, 
while the ones in the a subset are always odds. Applying 
the gauge erf — ► crfa^ +1 , Vi G (1,-N) the even measure is 
unaffected by this transformation (<J 2 f +1 = 1) while the 
odd measure takes a un+i inside the Boltzmann measure. 

(Q) = (59) 

u n a s n b 

nm, {j}) n n <t ) n n 4 )■ 
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At the end we can replace in the last expression the index 
N + 1 ol on+i by k for any k ^ {if} and multiply by 
one as 1 = iV _1 $^ fc=0 . Up to orders 0(1/N), which go 
to zero in the thermodynamic limit, we have the proof. 

It is now immediate to understand that Theorem Q on 
a fillablc overlap monomial has the effect of multiplying 
it by its missing part to be filled (Theorem [7]) , while it 
has no effect if the overlap monomial is already filled 
(Theorem H). □ 

Proof of Proposition [9] 

The proof works by direct calculation: 



Now noting that 



nu(i 



{l + u> t t 



<j,-i...cr.p-i( 



l.s 



1 + V &...*%. 



E„a „a „b b n2 
(T-l ...(T.p-i(T-i ...a. p -iU 
l o «o l o l 



a<b 
1 — SU)tt 



£(£+1) - 2fl2 
2| t 



d(F s 



dt 



(60) 



we obtain 



<9E 

at 



2a p " 1 E 



il t (F s e 'o ) 



E^^/s^-^-x) 



25 p " 1 (^ 



2aE 



r fl t (F s H s a=1 (cosh /? + a S . . . (i a p _ , sinh /?) ) 



O t (n^ =1 (cosh/? + cr,fi...cr a p _ 1 sinh/3)) 



2a p - 1 (F s ) t , a 



25 p - 1 (E 



fi 4 (F s n« =1 (i + ^-^-^)) 



d(F s ) tt& 
dt 



= 25P- 



1,8 



a(F s (l + ^<i...a; rl 0+ (61) 



a=l 



>V' ..V <t? ...^ I) 1 ■ ...;■) x 

^-^ % a ia % a l a J 



a<b 

x ( 1 — sa)j6 



£(£+1)-: 



from which our thesis follows. □ 
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